Display apparatus with a sensor and camera and control method thereof

ABSTRACT

A display apparatus having a sensor and camera and a control method thereof are provided. Exemplary embodiments relate to a display apparatus and a control method thereof which determines through a sensor, such as a pyroelectric infrared ray (PIR) sensor, and a camera, whether a user intends to use the display apparatus, and drives the display apparatus based on the users intentions in order to reduce booting time.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a Divisional of U.S. application Ser. No.14/050,852, filed on Oct. 10, 2013, which claims priority from KoreanPatent Application No. 10-2012-0140494, filed on Dec. 5, 2012 in theKorean Intellectual Property Office, the disclosure of which isincorporated herein by reference, in its entirety.

BACKGROUND

Field

Apparatuses and methods consistent with the exemplary embodiments relateto a display apparatus and a control method thereof. More particularly,exemplary embodiments relate to a display apparatus and a control methodthereof which determines, through a pyroelectric infrared ray (PIR)sensor and a camera, whether a user intends to use the displayapparatus, and drives the display apparatus in advance of the userrequest in order to reduce booting time.

Description of the Related Art

The development of technology has encouraged development of variousdisplay apparatuses. A user generally uses a remote controller to turnon a TV. In response to the user pressing an ON button from the remotecontroller, the TV receives a signal from the remote controller throughan infrared sensor. Then, the TV begins its driving operation. From thetime the user presses the button on the remote controller to the timewhen a normal TV screen is driven through a TV panel, booting time isrequired. However, the user may feel that the booting time takes toolong.

SUMMARY

Accordingly, one or more exemplary embodiments provide a displayapparatus and a control method thereof which reduces booting time.

Another exemplary embodiment is to provide a display apparatus and acontrol method thereof which performs a security function.

Still another exemplary embodiment is to provide a display apparatus anda control method thereof which consumes less power.

Yet another exemplary embodiment is to provide a display apparatus and acontrol method thereof which promotes the convenience of users.

The foregoing and/or other aspects of the exemplary embodiments may beachieved by providing a display apparatus including: a display; at leastone sensor configured to sense a motion within a predetermined distancein at least one of front, left and right directions while in anactivated state; a camera configured to extract image information of anobject located in front of the display apparatus; and a centralprocessing unit (CPU) configured to be activated by a sensing signalfrom the at least one sensor, activates the camera, and controls powersupplied to the display according to an analysis result of the imageinformation of the object provided by the camera.

According to an aspect of another exemplary embodiment, the CPUidentifies whether the object is a human or a pet.

According to an aspect of another exemplary embodiment, the CPUdetermines supply power to the display according to whether the objectintends to use the display apparatus, in response to an identificationthat the object is the human. The foregoing and/or other aspects of theexemplary embodiments may be achieved by providing a display apparatusincluding: at least one sensor configured to sense a motion within apredetermined distance in at least one of front, left and rightdirections while in an activated state; at least one camera configuredto extract image information of an object; and a central processing unit(CPU) configured to be activated by a sensing signal from the at leastone sensor, activates the at least one camera, and performs a securityoperation according to an analysis result of the image information ofthe object provided by the camera.

According to an aspect of another exemplary embodiment, the securityfunction may include at least one of outputting a warning sound,outputting a warning screen, a recording function, and externaltransmission of data.

According to an aspect of another exemplary embodiment, the datatransmitted to the outside may include information that has beenrecorded by the camera.

According to an aspect of another exemplary embodiment, the CPU comparesthe image information of the object with stored image information inorder to determine whether to perform the security function.

According to an aspect of another exemplary embodiment, the CPU selectsand activates the at least one camera in the same direction as the atleast one sensor having the sensing signal.

According to an aspect of another exemplary embodiment, the sensor mayinclude one of an infrared sensor, a broadband RF sensor, a radar sensorand an ultrasonic sensor.

According to an aspect of another exemplary embodiment, the sensor isactivated through a graphic user interface (GUI).

The foregoing and/or other aspects of the exemplary embodiments may beachieved by providing a control method of a display apparatus including:activating a sensor, transmitting to a central processing unit (CPU) asensing signal of the sensor in order to activate the CPU; activating acamera by the CPU activated by the sensing signal and receiving from thecamera image information of an object located in front of the displayapparatus; analyzing the received image information of the object by theCPU; and controlling power supplied to a display according to ananalysis result by the CPU.

According to an aspect of another exemplary embodiment, the CPU suppliespower to the display in response to an identification, through theanalysis of the image information of the object, that the object intendsto use the display apparatus.

The foregoing and/or other aspects of the exemplary embodiments may beachieved by providing a control method of a display apparatus including:activating a sensor, transmitting a sensing signal of the sensor to acentral processing unit (CPU) to activate the CPU; activating a cameraby the CPU, the camera being activated by the sensing signal andreceiving from the camera image information of an object located infront of the display apparatus; the CPU searching a database for imageinformation related to the object; and performing a security function inresponse to no corresponding image information being found.

Another exemplary embodiment may provide a display apparatus forreducing booting time, the display apparatus including: at least onesensor configured to sense a motion within a predetermined distance,while in an activated state; a camera configured to extract imageinformation related to an object located in front of or near the displayapparatus; and a central processing unit (CPU) configured to beactivated by a sensing signal from the at least one sensor, activate thecamera, and performs a security operation according to an analysisresult of the image information related to the object provided by thecamera. Power may be turned off except for minimal power to the sensor,prior to the CPU receiving a signal from the sensor.

The CPU may be configured to identify whether the object is a human or apet, and the security function may include at least one of outputting awarning sound, outputting a warning screen, a recording function andexternal transmission of data.

The CPU may compare the image information of the object with storedimage information in order to determine whether to perform the securityfunction.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will become apparent and more readilyappreciated from the following description of the exemplary embodiments,taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram of a display apparatus according to anexemplary embodiment;

FIG. 2 is a flowchart showing a method of controlling the displayapparatus in FIG. 1;

FIG. 3 is a block diagram of a display apparatus according to anotherexemplary embodiment; and

FIG. 4 is a flowchart showing a method of controlling the displayapparatus in FIG. 3.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Below, exemplary embodiments will be described in detail with referenceto accompanying drawings so as to be easily understood by a personhaving ordinary knowledge in the art. The exemplary embodiments may beembodied in various forms without being limited to the exemplaryembodiments set forth herein. Descriptions of well-known parts areomitted for clarity, and like reference numerals refer to like elementsthroughout.

FIG. 1 is a block diagram of a display apparatus according to anexemplary embodiment.

As shown therein, the display apparatus according to this exemplaryembodiment includes a receiver 110, a PIR sensor 120, a camera 130, acentral processing unit (CPU) 140 which receives signals from, ortransmits signals to, the receiver 110, the PIR sensor 120 and thecamera 130, a storage 150 which supplies data necessary for operationsof the CPU 140 or stores therein data supplied through the CPU 140, anda display 160 which displays an image thereon to be recognized by auser, based on the data supplied by the CPU 140. The display 160 has animage displaying function and an audio outputting function.

As will be explained below, an example of the display apparatus is a TV,but not limited thereto. Alternatively, the display apparatus mayinclude a DVD player, computer, projector, or other electronicapparatuses which need booting time for implementing substantialoperations.

Most of display apparatuses include an infrared sensor or a camera andprovide additional services. The display apparatus employing theinfrared sensor deems any object having the temperature of a human body,as a human. In response to the heat source making no motion for acertain period of time, the infrared sensor determines that there is nohuman and thus may turn off the display apparatus or may restrict someof the display functions in order to save power.

In response to the heat source making a motion, the infrared sensordetermines that there is a human and thus re-operates the displayapparatus. In the case of a display apparatus in which a camera isinstalled, in response to there being a form of a human (determined onthe basis of face/the trunk/pupil), the display apparatus determinesthat there is a human, according to its algorithm, and controls itsfunctions. With the foregoing technology, the display apparatus mayreduce power consumption or may monitor the environment where there isno one. In response to an infrared sensor being used, the displayapparatus may react to an animal rather than a human, or may malfunctionwith respect to a motion that is not made with the intention of viewingthe display apparatus. That is, in response to a pet wandering aboutwhen there is no human, or any person goes past the display apparatus todo other things, the display apparatus may operate. The displayapparatus, using a camera, may distinguish human and animals through thelocation of face and pupil, and may even identify whether or not thehuman is viewing the display apparatus. That is, the display apparatusmalfunctions less in recognizing a human body. To do so, a controlcircuit should be driven to process images taken by the camera, andpower consumption occurs.

The receiver 110 collectively refers to an element which acts as aninterface configured to receive an input signal from the outside or froma remote controller in a wired/wireless manner, as well as receiving abroadcasting signal. For example, in response to a power control signalbeing transmitted through a remote controller, power supplied to allelements of the display apparatus except for the sensor is cut off andthe control operation of the display apparatus is started.

The sensor according to this exemplary embodiment may include at leastone of an infrared sensor, a broadband RF sensor, a radar sensor using a10 GHz or higher frequency band and an ultrasonic sensor. The sensor maybe installed within/outside the display apparatus and may transmit asensing signal to the display apparatus. Depending on the type ofsystem, the display apparatus may include a CPU which is driven byminimum power. Depending on the type of system, a processor may beinstalled in the camera to process and determine an image input by thecamera, or the sensor may be installed in the CPU.

An example of the sensor may include a pyroelectric infrared ray sensor(PIR sensor). The PIR sensor uses pyroelectric effect where aferroelectric material which absorbs infrared heat energy causesspontaneous polarization, and in proportion to the change in thepolarization, electric charge is abandoned. In response to the sensor120 including a PIR sensor, the PIR sensor senses infrared rays emittedby an object in response to such object being near the monitored area.Hereinafter, an example of the sensor installed in the display apparatuswill be described.

The camera may include a complementary metal oxide semiconductor (CMOS)camera or charge-coupled device (CCD) camera. The CMOS camera is animaging device which directly amplifies an electric charge into anelectric signal through amplifiers provided in all photodiodes. The CMOScamera has a simple circuit configuration and thus consumes less powerand requires lower manufacturing costs. As the amplifiers are providedin all photodiodes, the CMOS camera provides non-uniform image qualityand may have worse quality than a CCD.

FIG. 2 is a flowchart showing a method of controlling the displayapparatus in FIG. 1. Except for the sensor, power supplied to all ofelements of the display apparatus is cut off. Activation of a powercontrol function of the display apparatus may be set by a user. Morespecifically, a user may set the power control function through a remotecontroller; a switch provided in the display apparatus or by graphicuser interface (GUI). Further, a user may activate the power controlfunction by using a reservation function or may activate the powercontrol function automatically in response to an image of an object notbeing sensed until a predetermined time has past. Turning on or off anyelement may be decided as intended by a user or depending upon thenature of the display apparatus. In response to the power controlfunction being activated, only the sensor operates through a minimumdriving current. In response to the sensor being provided outside thedisplay apparatus, only a predetermined device which is capable ofreceiving a signal from the sensor may be activated (S201).

The sensor that is activated solely senses a motion of an object locatedwithin a predetermined distance from the display apparatus. The sensormay include at least one of an infrared sensor, a broadband RF sensor, aradar sensor and an ultrasonic sensor (S202). The infrared sensor may beimplemented as a PIR sensor.

A sensing signal of the at least one sensor is transmitted to the CPU.Upon receiving the sensing signal from the sensor, the CPU is activated(S203).

The CPU which is activated by the sensing signal outputs a controlsignal to activate the camera. The camera which is activated by the CPUacquires image information related to the object. The camera transmitsto the CPU the image information related to the object (S204).

Upon receiving the image information of the object from the camera, theCPU determines whether the object is a human or a pet, based on thereceived image information related to the object. In response to adetermination that the object is a pet, the display apparatus returns toits original state. That is, the power supplied to the camera is cutoff, and the signal is transmitted to a power source (not shown) to cutoff power supplied to the CPU. Accordingly, the power supplied to all ofelements of the display apparatus except for the sensor is cut off(S205).

In response to the CPU determining that the object is a human, the CPUanalyzes the image information related to the object. According to theanalysis result, the CPU controls power supplied to the display. Thatis, the CPU determines whether the image information related to theobject includes an image indicating a user's intention to use thedisplay apparatus. For example, the CPU determines whether the imageinformation includes recognition of a face and pupil of the object or atouch of the remote controller by the object. The intention to use thedisplay apparatus may be identified in response to predetermined timehaving past while the object located within the predetermined distanceis looking to the display apparatus (S206).

In this case, the CPU determines that the object intends to use thedisplay apparatus, and supplies power to the display, including abacklight, configured to perform normal operations. Further, the CPU maysupply power to all elements of the display apparatus, including anetwork (S207).

In response to a user's sight being directed toward another directionfor a long time, or in response to a user being asleep, or the user isdetermined to have disappeared from the recognizable area of the camera,the display apparatus according to this exemplary embodiment may performthe power control function. For example, the display apparatus may turnoff the backlight, gradually reduce the brightness of the screen or maycut off power supplied to all of elements of the display apparatus,other than the sensor, to prevent unnecessary power consumption. Ofcourse, the control function may be performed in connection with thedisplay apparatus and the control method thereof, as shown in FIGS. 1and 2.

FIG. 3 is a block diagram of a display apparatus according to anotherexemplary embodiment. FIG. 4 is a flowchart showing a method ofcontrolling the display apparatus in FIG. 3. The first exemplaryembodiment relates to the control method for reducing power consumption,and this exemplary embodiment relates to a device and a method forperforming a security function as well as power consumption.

As shown in FIG. 3, the display apparatus according to the anotherexemplary embodiment includes a receiver 210, at least one sensor 220,which may be implemented as a PIR sensor as shown, at least one camera230, a central processing unit (CPU) 240 configured to receive signalsfrom, or transmit control signals to, the receiver 210, the sensor 220and the camera 230; a storage 250 configured to supply data necessaryfor operations of the CPU 240 or may store therein data supplied throughthe CPU 240; a display 260 configured to display an image thereon to berecognized by a user, based on the data supplied by the CPU 240, anaudio output 270 which outputs a warning sound or recorded audioinformation based on a control signal from the CPU 240, and acommunicator 280 which may be configured to exchange data with anexternal network 300 in a wired/wireless manner. The audio output 270may be included in the display 260. The same operations as thoseaccording to the first embodiment will not be explained, repetitively.

Detailed operation of each element will be described with reference toFIG. 4.

A user may activate or inactivate a security function through setup ofthe display apparatus. The security function may be activated by asetting signal from the outside, as the case may be. As explained above,the security function may be set through a remote controller, GUI, or asetup button in the display apparatus (S401).

In response to one of the foregoing setting methods being used toactivate the security function, power supplied to all of the elements ofthe display apparatus, except for the sensor 220 is cut off, and onlythe sensor 220 is activated. Thus, only minimum power is consumed. Thesensor 220 may sense an object located within a predetermined distancein three directions of forward, left and right directions from the placewhere the display apparatus is located. The sensing capability of eachsensor may be equal or different. Further, a plurality of sensors may beselectively activated by a user's setting. In response to at least onesensor sensing the object (S402), the sensor transmits a sensing signalto the CPU 240 (S402).

The CPU 240 is activated by the sensing signal. The activated CPU 240outputs a control signal to a camera 230 to supply power thereto. TheCPU 240 may select the camera 230 pointing in the same direction as thesensor which has transmitted the sensing signal, and may supply power tothe selected camera 230.

The camera 230 which is activated by the control signal of the CPU 240extracts image information related to the object and transmits the imageinformation to the CPU 240 (S404).

The CPU 240 determines whether the object is a human or a pet, based onthe image information related to the object transmitted by the camera230. In response to a determination that the object is a pet, the CPU240 outputs a control signal to return to an initialization state forthe security function. That is, the CPU 240 outputs a signal to a powersource (not shown) to cut off power supplied to the CPU 240 itself aswell as power supplied to the camera 230 (S405).

In response to a determination that the object is not a pet but a human,the CPU 240 searches the image information of the object from thestorage 250. The image information stored in the storage 250 is imageinformation relating to a human who is allowed to use the displayapparatus. The CPU 240 determines whether the object is an authorizedperson. If so, the CPU 240 may return to its original state, as in thecase where the object is determined to be a pet at operation S405, ormay determine whether the object intends to use the display apparatus,as in the first exemplary embodiment (S406).

In response to the object being an authorized person who is authorizedto use the display apparatus, e.g. a family member, the CPU performs thesecurity function. The security function may be performed in variousforms. For example, a warning sound may be output through the audiooutput 270, or the display 260 may be driven to output a warning screenin order to notify the object that the security function is beingperformed. At the same time, the image information related to the objectthat is extracted through the camera 230 may be transmitted to theexternal network 300 through the communicator 280 without any additionalalarm operation. The external network 300 may refer to an owner of thedisplay apparatus 200 or a device which can provide information to anearby police station or a security service company. The informationtransmitted to the external network 300 through the communicator 280 mayinclude a text message that is transmitted together with, or separatelyfrom, the image information related the object. The image informationrelated to the object may be stored in the storage 250 (S407).

The display apparatus and a control method thereof according to theexemplary embodiments may have the following effects:

First, power consumption of the display apparatus may be reduced.

Second, booting time for the display apparatus may be reduced.

Third, a security function may be performed.

Although a few exemplary embodiments have been shown and described, itwill be appreciated by those skilled in the art that changes may be madein these exemplary embodiments without departing from the principles andspirit of the invention, the range of which is defined in the appendedclaims and their equivalents.

What is claimed is:
 1. A display apparatus comprising: at least onesensor configured to sense a motion within a predetermined distance inat least one of front, left and right directions, while in an activatedstate; at least one camera configured to extract image informationrelated to an object; and a central processing unit (CPU) configured tobe activated by a sensing signal from the at least one sensor, activatesthe at least one camera, and performs a security operation according toan analysis result of the image information related to the objectprovided by the camera.
 2. The display apparatus according to claim 1,wherein the security function comprises at least one of outputting awarning sound, outputting a warning screen, a recording function andexternal transmission of data.
 3. The display apparatus according toclaim 2, wherein the data transmitted to the outside comprisesinformation that has been recorded by the at least one camera.
 4. Thedisplay apparatus according to claim 1, wherein the CPU compares theimage information related to the object with stored image information inorder to determine whether to perform the security function.
 5. Thedisplay apparatus according to claim 1, wherein the CPU selects andactivates the at least one camera facing in the same direction as the atleast one sensor sensing the motion.
 6. The display apparatus accordingto claim 1, wherein the at least one sensor comprises one of an infraredsensor, a PIR sensor, a broadband RF sensor, a radar sensor and anultrasonic sensor.
 7. The display apparatus according to claim 1,wherein the at least one sensor is activated through a graphic userinterface (GUI).
 8. A method of controlling a display apparatus themethod comprising: activating a sensor, transmitting a sensing signal ofthe sensor to a central processing unit (CPU) in order to activate theCPU; activating a camera by the CPU, the camera being activated by thesensing signal and receiving from the camera image information relatedto an object located in front of or near the display apparatus;searching for the image information related to the object from adatabase by the CPU; and performing a security function in response tono corresponding image information being found.
 9. A display apparatusfor reducing booting time, the display apparatus comprising: at leastone sensor configured to sense a motion within a predetermined distance,while in an activated state; a camera configured to extract imageinformation related to an object located in front of or near the displayapparatus; and a central processing unit (CPU) configured to beactivated by a sensing signal from the at least one sensor, activate thecamera, and performs a security operation according to an analysisresult of the image information related to the object provided by thecamera.
 10. The display apparatus of claim 9, wherein power is turnedoff except for minimal power to the sensor, prior to the CPU receiving asignal from the sensor.
 11. The display apparatus according to claim 9,wherein the CPU is configured to identify whether the object is a humanor a pet.
 12. The display apparatus of claim 9, wherein the securityoperation comprises at least one of outputting a warning sound,outputting a warning screen, a recording function and externaltransmission of data.
 13. The display apparatus of claim 9, wherein theCPU compares the image information related to the object with storedimage information in order to determine whether to perform the securityoperation.